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Overview 

The work in this research project has been focused on the construction of 
a hierarchical hybrid control theory which is applicable to flight management 
systems. The motivation and underlying philosophical position for this work 
has been that the scale, inherent complexity and the large number of agents 
(aircraft) involved in an air traffic system imply that a hierarchical mod- 
elling and control methodology is required for its management and real time 
control. In the current work the complex discrete or continuous state space 
of a system with a small number of agents is aggregated in such a way that 
discrete (finite state machine or supervisory automaton) controlled dynamics 
are abstracted from the system’s behaviour. High level control may then be 
either directly applied at this abstracted level, or, if this is in itself of signif- 
icant complexity, further layers of abstractions may be created to produce a 
system with an acceptable degree of complexity at each level. By the nature 
of this construction, high level commands are necessarily realizable at lower 
levels in the system. 

Current work is concentrating on the extension of the research summa- 
rized here to cases where many agents and, in addition, various disturbances, 
enter the dynamics of the base level system. 

Brief Description of Results 

The results which have been obtained fall into the six main groups below. 

Discrete Hierarchical Control Theory: Finite State Machines 

The notion of Dynamical Consistency (DC) as a key idea for the aggre- 
gation of the dynamics of control systems first appeared in the 1995 Systems 
and Control Letters (SCL 1995) paper of PEC and Y. J. Wei and was re- 
ported by them at the IFAC Congress of 1996. (See the publications list 
below for this other references to published work.) The principle notion is 
that, once any partition of the state space of controlled system has been cho- 
sen, a high level (i.e. abstract) controlled transition between any two blocks 
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is defined when all the states in the first of the two blocks can be driven 
(without detours into other blocks) through the first block into the second. 
The control sequence may differ for different initial states in the first block. 
Furthermore, a hierarchical lattice structure is shown to exist which permits 
the specification of hierarchical control systems for the original base system. 
One of the principal results of this theory is that subject to the condition 
that all blocks are controllable with respect to themselves (in-block control- 
lability (IBC)), the base machine is controllable if and only if the partition 
machine is controllable. In other words, high and low level controllability are 
equivalent subject to the IBC condition. 

For systems with identified start and terminus state sets, the ideas above 
were generalized by PEC, Gupta and Shen so as to apply to complex sys- 
tems where controllability only needs to be defined with respect to these 
distinguished states sets. (See SCL, 1997\ CDC, 1997a. See also AIRTC 
1998). 

Supervisory Control 

Somewhat remarkably, these notions extend in a direct and comprehensi- 
ble manner to the controlled automata of Supervisory Control Theory; here 
control is exercised by disabling the so-called controllable events and control 
is conducted so as to prevent the uncontrollable events giving rise to unac- 
ceptable behaviour. In the papers of Hubbard, Shen and PEC ( CDC 1997b) 
and Hubbard and PEC ( WODES , 1998, CDC, 1998b) this development is 
presented in detail and applications to transfer lines are given. A key feature 
of the supervisory control framework (at any level of aggregation) is that it 
has an immediate interpretation as disturbance rejection theory. 

Hierarchically Accelerated Dynamic Programming (HADP) 

In the context of this research program and that of the air traffic control 
problem, we observed that the level by level construction of the partition 
machines permitted the introduction of a hierarchical version (HADP) of 
standard Dynamic Programming (DP). As described by Shen and PEC in 
CDC 1998c , enormous accelerations (of up to two or three orders of magni- 
tude) of solution of standard DP shortest path algorithms are made possible 
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by the use of HADP. Estimates of the suboptimality of the resulting solu- 
tions are given by the current theory (see CDC 1998c). Work continues to 
improve the results in this direction and to design more general and flexible 
software (I FAC, 1999b). 

Hierarchical Hybrid Control of Differential Control Systems 

Y.J. Wei and PEC (see Block 1996; IFAC, 1996; Ithaca, 1996; Lushan, 
1997; IEEE AC 1998) extended the theory of hierarchical control based upon 
the construction of the DC partition machines to the case where the base ma- 
chine is a differentiable control system. Despite the increase in the technical- 
ity of the construction, the strategy is conceptually parallel to the discrete 
base system case; it results in the abstraction of continuous base system 
dynamics into discrete higher level abstractions. 

Nonlinear Global Controllability with Application to the Con- 
struction of Hybrid In-Block Controllable (HIBC) Partition Ma- 
chines 

The work above has been deepened and extended iii the work of Lemch 
and PEC in the following ways: the crucial question of the robustness, or 
stability, of the abstracted partition machine (controlled) dynamics with re- 
spect to perturbations in the boundaries of the blocks defining the state space 
partitions is answered in the affirmative in HSCC ’98. This is subject to the 
Hybrid In-Block Controllability Condition (HBC), in addition to some tech- 
nical conditions. 

The representation of any finite machine by a partition machine of Some 
differential control system was established in SCL, 1998. 

The importance of the HBC property as a sufficient condition for the re- 
alizability of state-to-state controlled trajectories by a combination of high 
and low level controls, and its significance for the robustness of partition 
machine specification, led to the development of a general theory of nonlin- 
ear controllability which gives the HIBC property as an immediate product 
whenever the relevant hypotheses apply. This theory is presented by PEC 
and Lemch in the papers: HSCC ’98; CDC 1998a; CDC 1998d; IFAC, 1999a. 
An important feature of this work is that it naturally applies to Hamiltonian 
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systems and, further, systems such as the planar aircraft control model (for 
which first integrals may be shown to exist). 

Hybrid Partition Machines 

Finally, the work above has been applied in order to construct abstracted 
models of the “standard” (base level) hybrid system models. This results in 
discrete (high level) partition machine representations of such conventional 
hybrid systems and permits the high + low level hierarchical control of such 
systems in the manner developed above for, respectively, discrete, supervisory 
and continuous base machines. This work is reported in: CDC 1998d; IFAC, 
1999; AAAI 1999. 
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